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ABSTRACT 


This thesis assesses the current state of Department of Army (DA) cost estimating 
and analysis (CE/A) and cost management (CM) capabilities. In particular, it supports 
the Deputy Assistant Secretary of the Army-Cost & Economics’ mission to provide DA 
with cost, performance and economic analysis in the form of expertise, models, data, 
estimates and analysis at all levels; and it identified opportunities for improvement in the 
way CE/A and CM communities can better serve the DA. 

The first step in this thesis was to identify which organizations in the DA 
employed CE/A and CM personnel. Next, questionnaires with which to elicit the 
information required for a complete baseline assessment were constructed, tested, and 
disseminated. Cost community employees filled out the questionnaires. The data 
collected was formed into useful categories, and displayed in informative ways. With 
data thus arranged, analysis was performed and recommendations made. 

This thesis provides understanding of practices, techniques, and standards within 
the DA CE/A and CM communities. It is the first phase of a larger effort to 
understanding the changes in human capital strategy necessitated by the advent of 
General Fund Enterprise Business System (GFEBS), the Army's version of enterprise- 


wide financial management systems. 
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EXECUTIVE SUMMARY 


Before the Department of the Army (DA) can determine what changes must be 
made within the Cost Estimating/Analysis and Cost Management communities to best 
support customer requirements in the 21st century, DA must first fully understand its 
current capabilities and practices with respect to its people, processes and technology. 
Professor Daniel Nussbaum, NPS, completed a similar survey and analysis for the 
Department of the Navy in October 2004, the results of which caught the interest of the 
United States Army. This previous work by Dr. Nussbaum and his current work with DA 
in assessing the Army's cost community have led to this thesis. 

This thesis was designed to be an assessment of the current state of Department of 
Army cost estimating, analysis, and management capabilities. Specifically, it evaluated 
the extent to which the cost estimating and analysis and cost management communities 
are meeting Army leadership's current and projected needs. In particular, it supported the 
Deputy Assistant Secretary of the Army-Cost & Economics’ (DASA-CE) mission to 
provide DA with cost, performance and economic analysis in the form of expertise, 
models, data, estimates and analysis at all levels; and it will produce opportunities for 
improvement in the way cost estimating and analysis and cost management communities 
can better serve the DA. 

The method used in developing this thesis is displayed in the following figure, 


and a more detailed explanation follows the figure. 
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Figure 1. Process for developing a baseline assessment of the DA cost 
community 
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The first step in this thesis was to identify which organizations within DA employ 
CE/A and CM personnel and, for each one, identify both the head of the organization and 
a POC for this study. Next, a questionnaire with which to elicit the information required 
for a complete baseline assessment was constructed, and a schedule for disseminating and 
collecting the questionnaires developed and agreed upon by participating organizations. 

The data required for this thesis was acquired in three ways. One is by the 
organizations’ POCs filling out the questionnaire on behalf of the organization. The 
POCs in this case received and returned the questionnaire via email. The second method 
was via face-to-face interviews with the chiefs of the CE/A and CM organizations. The 
third method was a web-based survey. For this survey distribution, the URL for the web- 
page was emailed to potential respondents, who were then able to access the survey on 
the web, and complete it at their leisure. 

Finally, the data collected in the previous step was formed into useful categories, 
and displayed in informative ways. With data thus arranged, analysis was performed and 
recommendations made. 

This thesis provided uniform understanding, across the DA cost community, of 
fundamental practices, techniques, and standards within the DA cost estimating and 
management communities, as well as an enhanced understanding of professional and 
advancement opportunities. This paper described the first phase of a larger effort to 
understanding the changes in human capital strategy necessitated by the advent of 
enterprise-wide financial management systems in the US DoD, the U.S. Army version 


being known as General Fund Enterprise Business System (GFEBS). 
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I. PURPOSE 


The purpose of this study is to establish the current status of the Army’s cost 
estimating and analysis (CE/A) and cost management (CM) communities regarding 
people, processes, and technology. Specifically, this study seeks to identify the 
following: 

1. What are the size, organization, and experience of the DA in-house cost 

estimating and analysis and cost management workforces? 

2. What analyses are done and at whose request? 

3. How are results transmitted and who receives the results? 

4. What processes exist for the execution of cost research, recruiting, training, 

knowledge sharing and QA, including accountability for timeliness and 

reliability? 

5. What data, estimating tools, research and IT infrastructure are available to 

support the cost estimating and analysis workforce? 

By developing this baseline assessment of the CE/A and CM communities now, 
the Department of the Army will be better situated to determine areas in need of 
improvement in order to best utilize the General Fund Enterprise Business System 
(GFEBS, descibed in following section) once it is fielded. This study will determine how 
well the CE/A and CM communities are meeting the needs of the Army, and identify 
those areas where Army leadership is not being fully served by the CE/A and CM 
communities. This study has the support of DASA-CE, Mr. Steve Bagby, with respect to 
his mission to "Provide the Army decision makers with cost, performance and economic 
analysis in the form of expertise, models, data, estimates, and analysis at all levels". : 
Specifically, it will evaluate the extent to which the cost estimating and analysis and cost 


management communities are meeting Army leadership's current and projected needs. 
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I. BACKGROUND 


The impetus for this study is previous work by Professor Daniel Nussbaum for the 
Department of the Navy on its Cost Estimating/Analysis capabilities. This previous 
study provided the Department of the Navy with a baseline assessment of its cost 
estimating and analysis capabilities with respect to people, processes, and technology, so 
that once future requirements were determined for this community, gap analysis could be 
performed, and future needs met. This Department of the Army study is being completed 
at the request of the DASA-CE, and will include the CM community as well as the CE/A 
community. Because the U.S. Army is preparing to implement GFEBS (see below), it is 
imperative that leaders within the CE/A and CM communities have an accurate 
assessment regarding their people, processes, and technology so as to identify 


opportunities for improvement prior to GFEBS implementation. 


A. PREPARING FOR THE GENERAL FUND ENTERPRISE BUSINESS 
SYSTEM 


Since 1990, there have been no fewer than eight acts of Congress or policies 
established by the Department of Defense insisting on quality costing procedures within 
Department of Defense organizations including the Department of Army. These acts or 
policies include 1) Chief Financial Officers Act (1990), 2) Government Performance 
Results Act (1993), 3) National Performance Review (1993), 4) Statement of Federal 
Financial Accounting Standards #4 (1995), 5) DoD Acquisition Reform Goal #10 (1997), 
6) USD (A & T) Issues ABC Guidance (1999), 7) Joint Financial Management 
Improvement Program (JFMIP) Core Financial Systems Requirements (2001), and 8) 
President's Management Agenda (2002). To assist the U.S. Army in attaining the quality 
mandated, the General Fund Enterprise Business System (GFEBS) will be implemented. 

GFEBS is to be an integrated financial management system which will include a 
commercial-off-the-shelf (COTS) Enterprise Resource Planning (ERP) system, Systems 


Integration (SI) services support, and Application Service Provider (ASP) services 


support. This new system, GFEBS, must be capable of supporting DoD with accurate, 
reliable and timely financial information. Specific tasks for the system include providing 
general ledger management, payment management, receivables management, funds 
management, cost management, and reporting. GFEBS must be a web-based system, 
accessible world-wide that can provide required information in real time to the Army's 
Installation Management Agency (IMA), Army National Guard (ARNG), and United 
States Army Reserve (USAR). 

Within DA, there are no fewer than 100 business systems that create information 
of financial importance. DA will eliminate the need for a minimum of 28 and possibly 
up to 59 of these systems by incorporating their functions into GFEBS. From the other 
Army areas which will be affected by the introduction of GFEBS, such as the acquisition 
and logistics fields, it is expected that at least 18 more systems can be replaced by 
GFEBS. When in full use, GFEBS will involve logistics (wholesale and retail), 
procurement, healthcare, personnel management and pay, and asset management. 

An example of how GFEBS can improve information accessibility, accuracy and 
timeliness was given by the Honorable Valerie Baldwin (ASA-FM&C) in her statement 
to the U.S. Senate's Armed Services Committee's Subcommittee on Readiness and 
Management: "Currently, the Army must engage in extensive data calls from multiple 
business systems to determine the number of soldiers in a medical-hold status. This 
information is important in determining manning and healthcare purposes. Once GFEBS 
is integrated with the human-resource management systems, individuals will be able to 
track this information along with the associated costs in a timely manner without 
assistance from other agencies or systems." 

The GFEBS acquisition strategy is designed to mitigate risk and ensure approval 
by OSD Domain Owners and ASD (NII). Risk is mitigated by defining each roll-out 
phase as an option, with implementation phases to run from FY 05 to FY 09. Each phase 
has measurable exit criteria and defined objectives with extensive reviews scheduled at 
the end of each phase. Contracts for GFEBS may be terminated if exit criteria are not 
met. The government will own all artifacts and deliverables, so reusable items will 


represent no additional cost to the Army. By involving all leaders throughout the entire 
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process, risk of developing a system that does not meet the requirements established by 


each department is greatly mitigated.” 


B. WHAT COST ESTIMATION AND ANALYSIS (CE/A) MEANS TO THE 
U.S. ARMY 


From the Department of the Army Cost Analysis Manual, MAY 2002, the 
following information is provided on cost analysis and its importance within the 


Department of the Army: 


Cost analysis is: (1) the act of developing, analyzing, and documenting 
cost estimates using analytical approaches and techniques. (2) The process 
of analyzing and estimating incremental and total resources required to 
support past, present, and future forces, units, systems, functions, and 
equipment. It is an integral step in the selection between alternatives by 
the decision maker. (3) A management tool used to help decision makers 
evaluate resource requirements at key management milestones and 
decision points in the acquisition process. 


Cost analysis is used to produce cost estimates for materiel systems, 
automated information systems, force units, training, and other Army 
programs and projects. Each cost analysis should contain: (1) a clear 
definition of what is being costed. (2) The specification of all assumptions, 
ground rules, and constraints, assumed or imposed, underlying the 
analysis. They must each be explained with adequate rationale. (3) An 
estimate of all expected costs, directly or indirectly associated with the 
project over its life, including disposal. The cost estimate must include the 
identification of all data sources used. (4) Risk and uncertainty analyses 
identifying any circumstances which could affect a course of action. (5) 
Key limitations in terms of elements that were excluded. 


The documentation supporting the cost analysis should describe the 
methodology used in developing these estimates. It also should identify 
all the data sources and include the computations used to estimate the 
costs. The documentation should be in sufficient detail to permit 
reviewers to follow the logic from assumptions to conclusion and to 
update the estimate at a later time. 


Cost analysis is a critical element in the Army acquisition process. It 
supports management decisions by quantifying the resource impact of 
alternative options. A quality analysis includes different acquisition 
strategies, hardware designs, software designs, personnel requirements, 
and operating and support concepts. As a program matures and more 
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information becomes available, the cost estimate grows in complexity and 
detail. One test of the utility of cost analysis is its ability to respond 
quickly to program turbulence. Army planners must have reliable and 
readily available information about the cost consequences of program 
changes, extensions, or cancellations. Cost analysts must develop models 
to support these quick turnaround analyses. 


Cost analysis plays a key role in budgeting the Army's operating tempo 
(OPTEMPO) related training costs. The Army's implementation of the 
DoD Visibility and Management of Operating and Support Costs 
(VAMOSC) program is the Operating and Support Management 
Information System (OSMIS) and the Army Military-Civilian Cost 
System (AMCCS). The DASA-CE manages the OSMIS program 
including developing and reporting reparable and consumable OPTEMPO 
costs for selected tactical systems by major command (MACOM). The 
development of the training mission budgets requires reliable OPTEMPO 
cost factors. AMCOS is a database, which provides personnel cost factors 
for estimating acquisition, installation operations and _ force/unit 
requirements. 


Cost analysis has an on-going role in the management of base operations. 
Cost analysis assists installations, MACOMs and HQDA in determining 
base support requirements, developing budgets, conducting cost benefit 
analysis, and performing special studies. At the HQDA level, USACEAC 
develops cost factors in support of the Army Chief of Staff for Installation 
Management (ACSIM) for both the Installation Status Report (ISR) and 
the Army Installation Management - Headquarters Information (AIM-HI) 
model. Other ACSIM efforts supported by cost analysis include A-76 
studies, Service Based Costing, and Standard Service Costing. 


With the establishment of the cost/outcome oriented Government 
Performance Results Act (GPRA), cost analysis has taken on a larger role 
in to support management of base operations. The managerial costing 
focus, to meet GPRA mandates, requires cost analysis in the measuring 
and management of cost and results. Cost analysis will be needed to 
develop methodologies, conduct studies and analyze data of the products 
and services provided through base operations. The prerequisite to cost 
management is cost measurement. There are numerous methods of 
measuring costs, all of which will require cost analysis skills now and in 
the future. Examples of cost measurement include, full cost, job-order 
cost, service based cost, activity based cost, standard cost, product cost, 
and responsibility cost to name a few. Though there are many examples 
of cost measurement each demands cost analysis support to make 
information meaningful to Army management. USACEAC will prepare a 


managerial costing manual in the future on Activity Based Costing, 
Service Based Costing and Standard Service Costing. 


Other uses of cost analysis in the Army are to: 


(1) Support decisions on program viability, structure, and resource 
requirements. 


(2) Evaluate the cost implications of alternative materiel system 
designs. 


(3) Provide credible and auditable cost estimates in support of 
milestone reviews during the acquisition process. 


(4) Assess the cost implications of new technology, new equipment, 
new force structures, or new operating or maintenance concepts. 


(5) Support the Planning, Programming, Budgeting, and Execution 
System (PPBES) process. This includes formulating and documenting 
Army Cost Positions (ACPs) on programs within the Program Objective 
Memorandum (POM) and the Budget Estimate Submission (BES) 
processes. 


(6) Determine the funds required for a given level of training or 
operational activity such as miles driven per year. 


Cost analysis applies scientific and statistical methods to evaluate the 
likely cost of a specific item in a defined scenario. In the real world, there 
are multiple uncertainties about the item's cost. Some "internal" 
uncertainties influencing cost are inadequate item definition, poor contract 
statement of work, optimistic proposed solutions, inexperienced 
management, and_ success-oriented scheduling. Some "external" 
uncertainties include funding turbulence, contractor's underestimating of 
complexity, contractor's changing business base, and excessive (or 
insufficient) Government oversight. In spite of uncertainty, the process of 
cost analysis is the most rigorous approach available to evaluate the costs 
of alternatives for the decision maker. 


Cost analysis does have limitations. Analysts develop cost estimating 
methodologies with an imperfect understanding of the technical merits and 
limitations of the item. The applicability of historic data is always subject 
to interpretation. Because of future uncertainties, there are limitations in 
determining the degree to which reality varies from the plan. 
Realistically, the cost analysis process cannot: 


(1) Be applied with cookbook precision, but must be tailored to the 
problem. 


(2) Produce results that are better than input data. 

(3) Predict political impacts. 

(4) Substitute for sound judgment, management, or control. 
(5) Make the final decisions. 


Despite these limitations, cost analysis is a powerful tool. Rigorous and 
systematic analysis leads to a better understanding of the problem. It 
improves management insight into resources allocation problems. 
Because the future is uncertain our best estimate will differ from reality.” 


C. WHAT COST MANAGEMENT (CM) MEANS TO THE U.S. ARMY 
From Army Finance web site, (http://www.asafm.army.mil/ceac/cm-abc/doc- 


arch/docs/ASP-appC.doc ), the following information is provided on Cost Management: 


Cost Management is a process of continuous improvement that 
simultaneously focuses on cost and performance to gain efficiencies and 
improve operations through informed decision making. Similar practices 
are widely used within the private sector and the Army has developed cost 
management training material to support a strong doctrine and to 
institutionalize this managerial approach within the Army. To enable 
managers and decision makers to manage costs effectively, good cost 
measurement creates cost awareness, provides relevant cost information, 
and correlates the information to mission performance. Successful cost 
management is a long-term solution that links to the organization’s 
strategy, educates and empowers employees, and encourages cost control 
through rewards and incentives. 


Integration of Cost Management practices into the 21° Century 
Army is designed to enhance decision making at all levels. This will 
require a culture change within the Army, recognizing that cost 
management is a necessary discipline for all managers and decision 
makers, both military and civilian. A sound Army cost management 
doctrine will assist us in understanding the “true” costs of producing 
goods and services, improving operations, and linking execution to Army 
strategies. Cost management fully supports continuous improvement to 
achieve the most efficient organization... Executing the Cost Management 


doctrine controls costs and improves efficiency by focusing on results, 
allowing the Army to meet future resource requirements. 


Successful implementation of Cost Management combines strong 
leadership support, a cycle of commitment and review, employee 
empowerment, and motivational incentives. With Army leadership 
serving as strong advocates, the cost management paradigm establishes 
goals and encourages participative behavior to achieve improved 
performance. 


Managerial Costing is the reconnaissance process for Cost 
Management. Cost Management must be supported by credible cost 
measurement tools (e.g. Activity Based Costing) that focus on true cost 
and meet the internal needs of managers and decision makers. The cycle 
of commitment and review is the key for managers to practice cost 
management successfully. This process has been established through 
installation prototypes and is depicted in diagram below. 


Commanders must provide the leadership support and need for 
cost management information. The necessity to “pull” or lead the cost 
reconnaissance process creates an atmosphere of cost awareness 
throughout the command. A cycle of forecasting and after action review 
provides a frequent feedback and accountability loop that drives 
continuous improvement and allows for the most efficient use of 
resources. 


Cost Management is a commitment to a new business discipline 
that strives for continuous improvement by managing cot for superior 
performance. To move forward, organizations must begin to act on 
current cost measurement initiatives and institutionalize cost management 
through sound doctrine and active leadership. 


COST MANAGEMENT 


Cost Warrior.Pull Managerial Costing (ABC) 
- Specify What to Measure - Credible Measurement of True 


« How to Present Information Cost of Consumption 


A Cycle Of 
Commitment/Review That 
Facilitates Continuous 
Improvement After Action Cost 


Cost Forecasting Rewdll 


¢ Performance Commitment + Basis for Accountability 


» Negotiated Future Costs + Explaining Results / Forecast 


Figure 2. Cost management and commitment / review 
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The strategic component of cost management should focus on the 
planning of priorities and setting of goals. This is achieved primarily at 
the Army Headquarter and MACOM level by establishing cost and 
performance goals. By establishing expected levels of cost to achieve 
desired outcomes, installations have goals to strive for through tactical 
Cost Management practices. 


Commanders focus on the tactical component of cost management 
by managing cost and performance through the cycle of commitment and 
review to achieve continuous improvement. Commanders set efficiency 
challenges to be achieved through the managing of activities, processes 
and cost. Gaining a better understanding of cost and performance will 
better enable organizations to achieve the strategic goals set by Army 
leadership.* 


D. ACTIVITY BASED COSTING 

In November, 1999, Secretary of the Army Caldera issued his Strategic Plan for 
Implementing Cost Management/Activity Based Costing. From Atkinson, we get the 
following information regarding Activity-based costing (ABC). 

Activity-based costing develops the idea of cost drivers that directly link 

the activities performed to the products manufactured. These cost drivers 

measure the average demand placed on each activity by the various 


products. Activity costs are then assigned to products in proportion to the 
demand that the products place (on average) on the activities.” 


To illustrate ABC, assume a welder spends 60% of his time working on widgets, 
and 40% of his time working on doohickeys. The cost of employing the welder would be 
assigned to the production costs of widgets and doohickeys, 60% and 40% respectively. 
If 10 widgets and 10 doohickeys were produced, then the manufacturing cost of each 
widget and doohickey includes 6% and 4% respectively of the cost of the welder. 

It was the intent of the Secretary of the Army that ABC would be implemented in 
11 major business areas that support mission readiness within three years. Specifically, 
the Army would pursue ABC as a tool for the local manager to better understand 
operational cost and performance. Secretary of the Army White emphasized the 


importance of ABC in November 2001 when he stated that through effective ABC, the 
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Army could better determine the costs of our operations, the causes of those costs, and 


how to better manage costs while improving productivity.° 
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Hl. APPROACH 


The approach used in preparing this thesis is displayed in the following figure, 


and a more detailed explanation follows the figure. 


ID Organizations _____, | Develop Baseline 
Questionnaire 
ID POCs 








| Develop | 














Data Collection 








Observations and 
Recommendations 





Data Analysis and Presentation 


Figure 3. Process for developing a baseline assessment of the DA cost 
community 


In this effort to provide a baseline assessment of the DA CE/A and CM 
communities, the following five tasks had to be accomplished: (1) define the CE/A and 
CM communities, (2) develop the required tools to collect the data, (3) distribute the 
survey (email, internet), (4) compile and analyze the results, and (5) identify 


opportunities for further research. 


A. DEFINING THE CE/A AND CM COMMUNITIES 

The first task, defining the communities of interest, was simple in theory, harder 
in practice. The organizational structure was already known, but the actual individuals in 
those positions and their contact information was not known. Once a preliminary roster 


of individuals was established, each potential participant was contacted by telephone. 
13 


With each contact, a brief description of the study was given in order to assist the POC in 
determining whether or not he or she would be the most suitable respondent within the 
organization for the survey. Individuals who felt they were contacted in error were asked 
to recommend someone within their organization who would be better suited to complete 
the survey. This process was repeated until each individual on the POC roster had agreed 
that he or she was the individual within a given organization best suited to complete the 
survey. Each participant was asked who else should be contacted in order to provide 
additional assistance with the study. By establishing a workable participant list as the 
first step, participants were able to provide assistance in developing the surveys as well as 


answering the surveys. 


83 
69 
128 
118 
average response rate = 10.3% 
upper Cl = 20.8% 
lower Cl = 0.0% 


set | 80] 20.0% 
soo 84 0.0% 
average response rate = 6.8% 

upper Cl = 10.7% 

lower Cl = 3.0% 





Table 1. Population and respondents for CM survey broken out by MACOM and 
series 


B. SURVEY INSTRUMENT DEVELOPMENT 
The second step in completing this study was to develop the surveys that would 
be used to collect the data. There were two, which originally differed slightly in that one 


was specific to the CE/A community and the other was specific to the CM community. 
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However, both were based on a previous survey constructed by Professor Daniel 
Nussbaum to establish a baseline estimate of the DoN CE/A community’. These surveys, 
like the original DON CE/A survey, were intended to obtain data on people, practices, and 
tools within the designated fields (see appendix A for CE/A survey, appendix B for CM 
survey). 

These two surveys were then offered to the previously established POCs, with the 
request to review them for clarity, appropriateness, and completeness. Once all POC 
comments were collected via email and incorporated into the survey, selected POCs were 
visited face to face in order to verify that the surveys would be adequate tools by which 
to attain the information required. At this point, it became evident that while the CE/A 
survey was ready for distribution, the CM survey needed further refinement. 

The initial CM survey, now known as CMV1, was taken to selected Army cost 
management experts for discussion and review. Over the course of two separate 
meetings (10 DEC 04 and 4 JAN 05), Dr. Daniel Nussbaum and his team of subject 
matter experts (SMEs) were able to craft a reasonable draft of a quality cost management 
survey for use by the Army. This new version (CMV2) was reviewed in detail by J. 
Reauff and his team of SMEs. The content was determined to be adequate, but the 
wording was improved to ensure minimal complications when being completed by 
personel within the Army cost management community. The result was CMV3, which 
was ready for presentation to DASA-CE Steve Bagby. The result of Steve Bagby’s 
comments created CMV4. 

CMV4 presented the biggest changes to date, in that all questions were now 
directed to the actual CM employee, instead of just the department heads/ division chiefs. 
This was not just a simple change in wording, but a much larger change in the target 
population, and potentially in the percentage of completed surveys returned. Instead of 
sending surveys to the 11 personnel in charge of the 11 business areas, surveys would 
now be distributed (via the internet) to the 9000 civilian employees working in CP-11 
within these business areas. 

After implementation of recommended changes from Mr. Bagby, CMV4 was sent 


to InsightExpress for posting to the internet. The version on the internet was slightly 
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different from CMV4, because of coding constraints (filling in a table became filling in 
several rows). This internet version of the survey is now CMV5, and was proofread by 
both myself and Dr. Nussbaum to ensure accurate translation from CMV4 and acceptance 
of the complete range of possible inputs. Once verified by all interested parties, the 


survey was then ready for distribution. 


c: SURVEY FIELDING 

The CE/A survey was originally intended to be distributed via the internet. 
Unfortunately, time constraints led to the decision to distribute the survey through email. 
This was a relatively painless process since the surveys were being distributed to only ten 
department heads/ division chiefs. These chiefs would then ensure the survey acurately 
reflected the information for their employees, and then submit there organization's 
information on one response sheet. This led to the distribution of only ten CE/A surveys 
yielding information on over 200 personnel. 

Due to a longer survey development time for the CM survey, there was more time 
to ensure the survey would be successfully entered onto the web. In order to post the 
survey to the internet, a recommendation was sought from people who had used web- 
based surveys in the past. CalibreSystems, an organization that provides contracted 
support to the Department of Defense, had used and highly recommended InsightExpress. 
After looking up the InsightExpress website, contact was made with the sales 
representative. InsightExpress was to provide the necessary services, which included 
programming the survey to the web, emailing the URL to participants, and collecting and 
forwarding the results. The approximate costs would be $1300.00. This price was 
dependent upon the size of the survey, number of participants, and whether or not the 
contracted company was to program the survey themselves or not (you may program 
yourself if so inclined), and who would send out emails in support of the surveys (another 
task you may do yourself in the interest of saving money). 

The survey was forwarded to CalibreSystems, who then contracted 
InsightExpress. Because of the information acquired and contacts established when 


attempting to post the CE/A survey, posting of the CM survey was able to be 
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accomplished in just a couple of days. CalibreSystems was able to provide a draft survey 
and an estimated number of participants a week in advance, which allowed 
InsightExpress to complete a cost estimate and forward a contract in advance. When the 
CM survey was finalized, InsightExpress was able to begin their programming work the 
next day. This allowed the CM survey to be available for completion by target 
population within just a couple of days. 

Once InsightExpress had the completed survey posted to the web, the URL for the 
survey was sent to our 9000 potential participants in two separate emails; one sent from 
DASA - FM&C, Ms. Valerie Baldwin, and the other from Ms. Terry Placek, head of 
Career Program (CP) 11. The purpose of the two emails was to convey as strongly as 
possible the chain-of -command's desire for cooperation in completing the survey in an 


accurate and timely manner. 


D. RESPONSE RATES 

In this phase of the study, the data provided through the surveys was collected, 
sorted into separate categories, and presented so as to be clearly understood. While it is 
ideal to have a 100% return rate on the surveys distributed, it was not the end result. For 
the CE/A survey, 8 of the 10 organizations surveyed provided inputs. These inputs were 
for a total of 212 CE/A personnel. Based on the number of responses, survey results have 
a 6.7% margin of error. Results for the CM survey were received from 6.8% of the CP- 
11 work-force, or 812 CM personnel. Based on the number of responses for the CM 
survey, there is a 3% margin of error. With the two separate surveys, practices and 
technologies unique to each community can be better captured without confusion on the 


part of the surveyor. 


E. IDENTIFYING OPPORTUNITIES FOR FURTHER RESEARCH 
Once the baseline has been established for the DA CE/A and CM communities, 
further study should be conducted to determine future requirements, and then conduct 


gap analysis. A study similar to this thesis was conducted for Department of Navy CE/A 
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community, so only the Department of the Air Force currently remains without a baseline 
estimate of their CE/A assets within the Department of Defense. Possibly the most 
immediate area of further research includes conducting the same survey and analysis as 
was performed for the cost management (CP-11) community for other CPs within DA. 
DASA-CE Steve Bagby intends to perform this study across the entire DAC population, 
and NPS students are ideally suited to ensure these additional studies are conducted in a 


timely, professional manner. 
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IV. RESULTS AND CONCLUSIONS 


All observations for DA CE/A will be listed first, followed by observations of the 
DA CM community. Data for the CE/A portion of this study was collected from SAFM- 
CES, CECOM, RDECOM, AFSC, TACOM, AMCOM, ACD&CRB, and ALMC. The 
data from the CE/A survey are listed in Annex C. After careful analysis of the results, we 
are able to make our observations. The CM results were obtained from a sample of over 
800 of the 11,000 DAC respondents working in CP-11. CM survey data are available at 
Annex D. 


A. CE/A RESULTS 

The CE/A survey was completed for 212 CE/A personnel from eight separate 
agencies within DA. Over 50% of all respondents are currently employed by AMCOM 
or TACOM. AMCOM had 30% of the total respondents with 63, TACOM had 23% with 
49, ACD & CRB had 19% with 40. Also submitting responses was SAFM-CES with 25, 
CECOM with 22, AFSC with 7, RDECOM with 4, and ALMC with 2. 
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Figure 4. Number and percentage of CE/A survey respondents by agency 


There were 212 respondents for pay grade. with 35 being GS 1 - 11, 125 being GS 


12 - 13, and 52 in the GS-14 through SES. This means 58% of all respondents are 
currently in the GS-12 or GS-13 pay grade. 
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Figure 5. Number and percentage of CE/A survey respondents by pay grade 


For years of CE/A experience, there were 200 respondents. Of these, 43 
(22%) have from | - 5 years of experience, 15 (8%) have 6 - 10 years, 57 (28%) report 
having 11 - 20 years of experience, and 85 (42%) have been doing CE/A work for at least 
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Number and percentage of CE/A survey respondents by years of 
experience 


Figure 6. 


For highest academic degree attained, there were 166 respondents. Only seven 
(4%) have no more than a high school diploma, 91 (55%) have a bachelor's degree, and 
68 (41%) have at least a graduate degree. 
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Figure 7. 


Number and percentage of CE/A survey respondents by highest 


academic degree earned 





For professional certifications earned, there were 168 accredidation certificates 
issued. DAWIA III has the most certificate holders with 101 (61%), while no one is 
certified by PMP. SCEA has awarded four (2%) certificates, nine (5%) have DAWIA I, 
30 (18%) have DAWIA I, and 24 (14%) have some other professional certification. 
Within the CE/A workforce, it is the case that some employees hold more than one form 


of certification, while other employees hold none. 
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Figure 8. Number and percentage of CE/A survey respondents by professional 


certifications 


For source of employee, there were 212 respondents. 91 (43%) say they came 
from college, 86 (41%) came from a different government agency, 32 (15%) from a 


commercial organization, and three (1%) reported coming from somewhere else. 
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Figure 9. Number and percentage of CE/A survey respondents by source of 


employment 


Additional items of interest concern what type of work our CE/A community 
performs, and at whose request. Seven agencies provided ranges for the amount of time 


spent by type of work. One agency spends between 20% to 50% of their effort 
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performing CE/A type work, with the other six saying they spend between 50% to 100% 
of their time doing CE/A work. 
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Figure 10. CE/A workload by agency 


For contract support, we find one of the CE/A agencies doing none of this work, 
and another agency doing this work over 50% of the time. Two agencies report doing 
contract support type work from 20% to 50% of the time, and three of the CE/A agencies 
do this work from 10% to 20% of the time. 
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Figure 11. Contract support workload by agency 
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Three of the CE/A agencies perform tool building operations from 10% to 20% of 
the time. The other four agencies are evenly split with one each performing tool building 


operations over 50% of the time, 20% to 50% of the time, less than 10% of the time, and 























not at all. 
Tool Building Workload by Agency 
100% 
100% 
80% 
: 60% 
% 40% 
2 
20% 20% 20% 
20% 
~~ EH 
0% 
SAFM-CES CECOM RDECOM AFSC TACOM AMCOM ACD&CRB 
Figure 12. Tool building workload by agency 


For administrative functions, only one spends 20% to 50% of its time doing this 
type of work. The majority (four) of the CE/A agencies spend between 10% to 20% of 


their time on these tasks, and the remaining two spend less than 10% of their manpower 











in this area. 
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Figure 13. Admin workload by agency 
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Work not included in the above categories is generally not done by CE/A 
organizations, with five of the seven reporting no other work at all, and only one each 
reporting doing other work less than 10% of the time or between 10% to 20% of the time. 

In order to determine the CE/A community's ability to meet customer 
requirements, we must determine who tasks the CE/A community and for what purposes. 
For CE/A tasks, PEO's task the highest percentage of our organizations (86%), followed 
by PMs and MACOMs with 71% each. SECARMY tasks the next highest percentage at 
57%, followed by HQDA (43%) and SECDEF (29%). Only 14% apiece said they were 
tasked by CAIG, MSC, or a subMACOM. 
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Figure 14. Percent of CE/A agencies tasked by the listed offices for CE/A tasks 


Contract support is tasked to the DA CE/A organizations by two primary sources. 
PMs task 71% and PEOs task 57% of the CE/A organizations for this purpose. No other 
agency, office, or organization tasks more than 14% of the CE/A agencies for contract 


support. 





100% 





80% 71 % 


57% 
60% 


40% 
20% 14% 14% 14% 14% 14% 
-_ . | . || . | 0% . 0% . L] . [] 
Oo Co SF 
SES EC SF SF PS # 
iS 





Co ¢ 
ws oS 











Figure 15. Percent of CE/A agencies tasked by the listed agencies for contract 
support 
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Origins for tool building tasks are a littke more evenly spread than the tasking 
origins are for contract support. PMs again task the highest percentage of CE/A 
organizations (57%) followed by PEOs and SECARMY with 43% each, and HQDA and 
MACOMsSs tasking 29% of the DA CE/A organizations for tool building. Only 14% of 


the CE/A organizations are tasked by any one other agency or organization. 
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Figure 16. Percent of CE/A agencies tasked by the listed agencies for tool 
building 
For administration, HQDA, MACOMs, PMs, and SECARMY task 29% of the 
CE/A organizations. No any other agency tasks more than 14% of CE/A organizations 


for administrative tasks. 
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Figure 17. Percent of CE/A agencies tasked by the listed agencies for 
administration 


The following comments also come from the CE/A survey. They provide insight 


into what the respondents would change to improve the CE/A community. The responses 
Zo 


fall into the categories of training and personnel, how to improve performance, and 
quality assurance/ quality control. 
Under the heading of training/personnel, we have the following comments: 

> "DA/MACOM should allow more input from the MSCs in the 
recruitment/selection process of the Operation Research Analysts. MSCs 
can often find the caliber of analysts they are looking for through their 
local academic institutions. " 

> "DA/MACOM should provide centrally funded interns to replace the 
aging CA community.” 

> "Comptrollers should be trained in the use and value of cost analysis 
products; e.g., HQ AMC should have a Cost Analysis." 

> "Much of CE/A guidance and training is focused on RDTE and 
production life cycle phases. A greater focus (more training) on the 
sustainment phase for the CE/A community would be helpful." 

Improved performance is the second category, with the following comments: 

> "Fund positions that would be used to perform internal cost research. 
DASA (CE) funds for cost research, but an internal cost methodology and 
data group would really improve cost products (e.g. life cycle cost 
estimates, economic analyses, etc.). With over 90% of the CE/A positions 
funded by customers (e.g. reimbursable) the CE/A community never has 
enough time (personnel available) to do the type of research and data 
collection that is so important to developing quality cost products. In 
years past this was a common group in most cost offices—performing 
fundamental cost research. Reconstituting this capability with central 
funding could do more than anything to enhance the cost community." 

> "Enforce existing policies and/or require data collection from all ACAT I 
and ACAT II contracts. The Cost Estimating / Analysis industry would 
function best if all estimates were performed at the mission level. The 
performance of cost estimates by HQ does not add value if they have to 


come to the local/mission level to gather information." 
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> "Place more emphasis on cost analysis and cost estimating of program 
requirements, with trade-offs on those requirements.” 

> "Take the cost analysis out of the budget/execution area, because when the 
focus is on the budget, cost estimates lose their value, and lose the insight 
of the user's requirements. To accomplish this, there should be more 
interface/coordination between the MACOMs/ MSCs and TRADOC cost 
analysts." 

Under the heading of Quality Assurance / Quality Control: 

> "Create DA field offices that would have more insight with their weapon 
systems to develop that independent/validation review of PEO/PM cost 
estimates/studies." 

> "Revamp the Analysis of Alternatives process so new system proponents 
are not in charge of the analysis." 

> "Cost studies for major systems should be validated at the local level [AW 
guidance similar to AMC-R = 37-4. Provide more government 
resources/personnel to perform cost research studies." 

> "More funds and resources are needed to enforce EVMS activities and 
independent reviews. Specifically, activities like EVMS oversight and 
other analyses which require independence should be centrally funded 


rather than PM funded." 
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B. CM RESULTS 

The CM survey was completed for 810 CM personnel from 39 separate agencies 
within DA. Almost 50% of all respondents represented are currently employed by AMC, 
HQDA, or IMA combined, while over 50% of the employing agencies had five or fewer 


respondents. 
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Figure 18. Number of CM respondents by MACOM 
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There were 810 respondents for pay grade, with over 200 belonging to each GS- 
12 and GS-13. Almost 700 of the 810 report belonging to GS-11 through GS-14. 
Noticeably absent was any respondent in the GS-10 pay grade. 


Less than 1% of all 























respondents were the pay grades GS-1 through GS-5. 
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Figure 19. Number and percentage of CM survey respondents by grade 


There were 810 respondents from 25 separate series, with 207 being series 0560, 


198 being series 0343, and 142 being series 0511. Nine of the series had only one 








respondent, and _ five of the series had only’ two _ respondents. 
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Figure 20. Number of CM respondents by series 
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There were 810 respondents for organizational level. 270 (33%) belong to 
HQDA, 145 (18%) report working at the HQ, MACOM level, 152 (19%) working at an 
other HQ above brigade level, and 243 (30%) working at a support, field, or local agency. 
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Figure 21. Number and percentage of CM survey respondents by organizational 


level 


There were 541 respondents for years of experience, with 241 (45%) having more 
than ten years of cost management experience. Sixty-three (12%) reported having less 
than one year of experience, 55 (10%) have one to two years, 100 (18%) have three to 


five years of experience, and 82 (15%) report having six to ten years of experience. 
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Figure 22. Number and percentage of CM survey respondents by years of 
experience 


There were 541 respondents for years in current position. With the 104 (19%) 
that have moved into their current position less than one year ago, the 141 (26%) that 


have been in place for one to two years, and (25%) that have worked in the same 
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position for three to five years, 70% of the respondents have five or fewer years in their 
current position. Fifty-seven (11%) have six to ten years in the same position, and 104 


(19%) have been in place for more than ten years. 
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Figure 23. Number and percentage of CM survey respondents by years in 


current position 


There were 541 respondents for source of employee, with 198 coming from their 
current organization and another 198 coming from another Army organization. These 
two sources account for 73% of the respondents. Apprroximately 11% came directly 
from either a different federal or DoD organization (61) or from the private sector (59), 


and 25 (5%) from some other source. 
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Figure 24. Number and percentage of CM survey respondents by source of 
employee 
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There were 810 respondents for highest academic degree earned, with 109 having 
only a high school diploma or equivalent. This means 87% of the respondents have some 
type of college degree. Seventy-seven (10%) have an associate's degree, 358 (44%) have 


a bachelor's degree, 256 (32%) have earned a master's degree, and 10 (1%) have earned a 




























doctorate. 
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Figure 25. Number and percentage of CM survey respondents by highest 


academic degree earned 


There were 542 respondents who said whether or not they were currently in a 
manager's or supervisor's role. 192 (36%) are serving as managers or supervisors, 349 
(64%) are not. 
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Figure 26. Number and percentage of respondents by whether or not they are 


mangers or supervisors 


There were 810 respondents for type of cost work they perform in their current 
positions. 363 perform cost analysis functions, 295 do cost collection, 222 do cost 


management functions, 211 perform cost measurement, and 146 perform costing support 
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functions. Many of the 810 perform more than one function, as 269 perform no costing 
functions at all. Of the 810 total respondents, 168 estimated the amount of time they 
spend on those functions that they do perform. The average amount of time spent on 
each function is as follows: 34.8% on cost analysis, 24.5% on cost management, 20.6% 
on cost measurement, 19.8% on cost collection, and 17.9% on costing support functions. 
Some respondents stated that they spent 100% of their time working on just one type of 
cost work for each option other than cost collection. No respondent stated to spending 


more than 90% of their time on that type of work. 
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Figure 27. Number of CM survey respondents who perform different types of 
cost work 
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Figure 28. Average amount of time respondents spent doing each type of cost 
work (if performed) 
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There were 541 respondents who answered the survey question asking whether or 
not their work was done in support of defense system acquisition management. Of those, 
420 (78%) say their work is not done in support of this important function, while 121 
(22%) say that it is. 
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Figure 29. Number and percentage of CM survey respondents whose work 
supports defense system acquisition management 


There were 542 respondents who said whether or not they generate costing 


information. Of these, 235 (43%) said no, 307 (57%) said yes. 
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Figure 30. Number and percentage of CM survey respondents by whether or not 


they generate costing information 


There were 542 respondents who selected from a list of tasks those that they have 
performed in their current position. A majority (361) have collected information for 
costing purposes, and performed analysis of cost information (349). 222 have linked cost 


information to performance measures. The next four tasks most often performed are: 
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used cost analysis to make decisions for improving an organization or process (192), 
participated in the creation of a strategic plan (190), provided assistance to an 
organization's leadership/ management in using cost analysis (187), and created non- 
budget cost information (180). Most respondents have completed more than one task in 


their current position. 
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Figure 31. Number of CM survey respondents who have performed the above 
costing tasks in their current position 
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307 respondents provided information on to whom they provide information, with 
233 providing cost information to their immediate supervisor, 190 to managers across 
their organization, and 128 to the head of their organization. Other recipients of costing 
information include higher headquarters (114), the organization's business or resource 
management office (92), organizations external to the cost provider (87), an information 
system accessible by multiple organizations (42), and 13 listed other organizations as 


recipients. 
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Figure 32. Number of CM survey respondents by who receives their costing 
information 


When asked if the head of their organization's ability to use costing information to 
improve the organization is part of the head of the organization's assessment, 542 people 


responded. 378 (70%) do not know, 99 (18%) say yes, and 65 ( 12%) say no. 
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Figure 33. Number and percentage of CM survey respondents by if the head of 
their organization's ability to use cost information to improve the organization is 
part of his/her assessment 


There were 542 respondents who rated the priority the head of their organization 
places on internal management and control of costs. 271 (50%) believe this priority is 
high, 194 (36%) say mid-level, 66 (12%) think it's a low priority, and 11 (2%) believe the 


head of the organization places no priority on this at all. 
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Figure 34. Number and percentage of CM survey respondents by the importance 
the head of their organization places on internal management and control of costs 


There were 542 respondents who rated the importance of internal management 
and control of costs to the success of their immediate supervisor. Of these, 191 (35%) 
believe this is very important, 197 (37%) say somewhat, 61 (11%) and 27 (5%) respond 
with not very important and not important at all, respectively. Sixty-six (12%) do not 


know. 
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Figure 35. 


Figure 36. 
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Number and percentage of CM survey respondents by how they rate 
the importance of internal management and control of costs to their immediate 
supervisor's success 


There were 542 respondents by if their ability to use costing information to 


imrove the organization is part of their assessment. 179 (33%) say yes, and 363 (67%) 
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Number and percentage of CM survey respondents by whether their 
ability to use costing information to improve their organization is part of their 
assessment 


There were 542 respondents who rated the importance of internal management 


important at all, respectively. 
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and control of costs to their own success. 178 (33%) believe this is very important, 233 


(43%) say somewhat, 86 (16%) and 45 (8%) respond with not very important and not 








Figure 37. 


organization's internal operations. 


Figure 38. 
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Number and percentage of CM survey respondents by how they rate 
the importance of internal management and control of costs to their personal 


There were 542 respondents for the impact of costing information and efforts on 
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251 (47%) believe the impact is significant, 164 
(30%) say there is some impact, 71 (13%) say minimal to none, 56 (10%) do not know. 
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Number and percentage of CM survey respondents by impact cost 


information and efforts have on organization's internal operations 


There were 542 respondents who rated the importance of internal management 





and control of costs to the success of their immediate supervisor. 314 (58%) believe this 
is very important, 145 (27%) say somewhat, 37 (7%) and 8 (1%) respond with not very 


important and not important at all, respectively. 38 (7%) do not know. 
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Figure 39. 


Figure 40. 
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Number and percentage of CM survey respondents by how they rate 
the importance of internal management and control of costs to their organization's 


There were 810 respondents for pay grade, with over 200 belonging to each GS- 


12 and GS-13. Almost 700 report belonging to GS-11 through GS-14. 


There were 542 respondents who rated the importance the external chain of 


command places on internal management and control of costs. 
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Number and percentage of CM survey respondents by importance the 
external chain of command places on internal management and control of costs 








There were 307 respondents who commented on how their costing information 
was used. Many allow that their information is used for more than one purpose. There 
were 185 who said their information was used to justify/generate resource requirements 
and budgets; 168 say to evaluate and make business improvement decisions for your 
organization; 167 believe it's to fulfill higher headquarter reporting requirements; 165 
think their information is used to measure and evaluate performance for their 
organization; and 164 say to manage and control costs for the organization. There were 
136 respondents who said measuring project progress and comparing alternatives for 


decision makers was the intended use of their costing information. 
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Figure 41. Number of CM respondents by the manner in which their costing 
information is used 


4] 





Number of CM Respondents who Use the 
Below Software 
N=307 


Other 


MS Excel 


MS Access 


Other database application (SQL, Oracle, etc.) 


ACET-IT 


SAS Oros 5.5 


Other ABC software application 


ECONPAK 





SAS ABM 6x |3 


0 50 100 150 200 250 300 350 











Figure 42. Number of CM survey respondents who use the above costing 
software 
There were 307 respondents for type of costing software used. Almost all, 293, 
use MS Excel, 108 use MS Access, and 87 use other database applications (such as SQL, 
Oracle, etc.). Less than 10% of the respondents use any one other type of costing 


software. 


There were 307 respondents for how sources of costing data, with 205 receiving 
data from financial management systems, 112 say from internal data collection sources, 
109 use Army websites. Other sources include resource management systems, internally 
developed software applications, contractors, non-Army websites, cost factor's databases, 


and others. 
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Internet websit esexternal tothe Army 
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Figure 43. Number of CM survey respondents by source of costing data 


There were 307 respondents for how cost data provide their costing data to others. 
241 use email, and 218 provide a hard copy report or brief. Importing a file 
electronically into a system was selected 71 times (and 64 let someone else do it for 
them), 64 manually enter information into a system, and 62 both posted to the web, and 


on aLAN. 
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Figure 44. Number of CM survey respondents by manner in which costing data 
is provided 
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There were 542 respondents to how costing information is shared. There were 356 
respondents who do so informally by assisting others when asked. Two-hundred-five 
conduct on-the-job training. Other methods of sharing information include giving 
briefings and presentations at professional forums (98), posting information to a locally 
established system (71), and presenting formal training (53). Writing articles for 
publication was used by 28 responents, participating in an email list-serve by 25, and 4 
post items to Army Knowledge On-Line. Surprisingly, 90 out the 542 say they do not 


share costing information. 





Number of CM Respondents who Share Information in the Below Manner 
N=542 


Conducting on-the-job training 
Giving briefings and presentations at professional 
forums 


Posting information to a locally established system 


Participating in an email list-serve 


Posting items in Army Knowledge On-Line (AKO) 
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Figure 45. Number of CM survey respondents by how they share costing 
information 
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Figure 46. Number trained in cost subjects since 1 JAN 00 


There were 486 respondents for subjects trained, with respondents able to be 
trained in more than one subject. By far, at 313, more people have received training in 
Activity based Costing/ Management than any other subject. The training of cost finding 
and estimating relationships seem to be lacking. Of possibly more importance, are the 
549 responses for training received in the methods/ tools that are used by the CM 
community. 60.8% of the respondents who have used EVM have received training in 


EVM. For other tools/ methods, the range runs from 38.6% (project or process costing) 
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to 47.6% (service based costing). By looking at this chart, we see clearly that fewer than 


50% of the respondents have received training on the tools they use in the workplace. 





Percent of CM Respondents who Have Received Training Since 1 JAN 00 
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Figure 47. Percentage trained in methods used 
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There were 541 respondents by use of tools/ methods, with respondents able to 
choose more than one method/ tool (70 chose none of the above). Trend analysis was 
used by 284, and ABC/M by 243. Project or process costing was used by 181 
respondents, economic analysis by 159, productivity improvement/ business process 
reengineering by 134, and service based costing used by 127 respondents. Other methods 


were reported as being used by less than 20% of the respondents. 
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Figure 48. Number of CM respondents by methods/ tools used 


There were 307 respondents for how costing data is validated, with respondents 


able to choose more than one answer. 224 compare with data from other sources, 117 use 
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data already validated by others, 96 statistically sample the data and verify its accuracy. 


28 respondents do not validate cost data, and 11 respondents use other methods. 
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Figure 49. Number of CM survey respondents by how they validate data 


There were 307 respondents for how often they update cost information. Of 
these, 93 update information monthly, 49 do so daily, and 42 do so weekly. Of the 49 


who chose other, most of these were determined to be as required based on the job, data, 


or other requirements. 
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Figure 50. Number and percent of CM survey respondents by how often they 


update costing information 


There were 542 for how often costing information is formally reviewed by 


leaders/ managers, with 221 (41%) saying they do not know. 124 (23%) say monthly, 
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quarterly was selected 49 times (11%), and daily was selected 40 times (7%). 10 (2%) 


respondents believe their manager/ leader never formally reviews cost information. 
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Figure 51. Number and percentage of CM survey respondents by how often their 


leaders/managers formally review costing information 


There were 541 respondents who selected the top three features they would like to 
see in GFEBS. The capability to perform queries and data downloads without technical 
assistance was selected by 339 respondents, 316 selected the ability to link financial data 
with workload, performance, and other cost data to generate process, project, activity, 
product, burdened, and full costs. Next at 213 comes the capability to seamlessly merge 
financial data with other data or factors to generate variance, economic, and cost-benefit 
analyses or to derive cost rates and cost/revenue estimates, followed by a system that 
automatically updates standard reports and charts with 202 selections. The remaining 
options and the number of selections include: Ability to link financial transactions with 
transactions in other functional systems (173); Possesses strong ad hoc reporting 
capability with ability to drag and drop data to spreadsheet (156); Capability to build next 
year’s budget based on current and/or previous year execution (152); Ability to 
electronically assign or withdraw funding authorities without incurring Ant-Deficiency 


Act violations (56). 
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Figure 52. Number of CM survey respondents by most important features of 
GFEBS 


From the CM survey, we also received comments on how to improve the cost 
community. Of the 810 comments regarding how to improve the cost community, the top 


categories for comments were no-comment, training, system requirements, and data 
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collection-validation. I have ignored the no-comment category, and provide examples of 
the others. 
Training comments included: 
> "Ensure that courses of instructions are developed that are relevant and applicable 
to the Army's business." 
> "MORE TRAINING!" This comment was made more than any other. 
> "More Cross Functional Training - Change Culture from Budget Management to 
Cost & Performance Management." 
> "Asa supervisor, I would like to provide bi-weekly training sessions (maybe 1-2 
hours long) to my employees. I do not have the time to develop a lesson plan. I 
would like to see standardized lesson plans available on a website that I could 
access and use to conduct cost analysis training to my employees." 
Data collection and validation comments included: 
> "The data captured in most systems are not reliable. The individuals required to 
enter data don't understand what data is to be captured and why. Accounting 
systems do not really capture cost data but we treat the data as though it is. In the 
corporate world, cost data is tracked separately from accounting data." 
> "Make data more accessible." 
> "VALIDATE!" 
> "Cost data needs to be validated at each level of aggregation. Logic checks and 
analyses of unexpected and unusual costs should be performed. Cost definitions 
need to be standardized. One-time, fixed and variable costs need to be 
segregated." 
Comments about system requirements included: 
> "It needs financial systems/reports that allow "drill'down" into the causes of cost 
changes. Needs the ability to integrate budget data with execution data to allow 
analysis instead of spending excessive amounts of time cleaning and aligning 
data." 
> "Have standard systems that link supply, maintenance and other functional 


systems to the financial systems." 
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> "Improvements to financial systems that are compatible with and link to one 
another. Use off-the-shelf systems, as opposed to internally developed systems - 
an integrated system from the field to upper HQDA management." 

> "The biggest challenge seems to be that the planners have a difficult time figuring 
out what the executers have done/are doing. To deal with this: * ensure that data is 
recorded correctly at lowest levels (standardization, training). * Demand that ALL 
data flows to a central database regardless of system enter into. * Allow access to 
query this database." 

> "Minimize the amount of and standardize the financial systems software/web 
based and ensure that they all interface with each other. There are too many 
different programs that are used, clearly a waste of government funds. There are 
more dollars spent on developing/implementing/training/fixing then paying 
attention to what we have and cleaning out the programs that are not compatible 
and stand alones. The military civilian work force is short handed and the 
demands versus the ability to produce are out of balance. Necessary steps are 
being passed over just to get the job done whether the data is correct or not. This 
is all due to bad programming of the workforce. When developing financial 
programs the end user needs to always be involved in the process from the 
beginning." 

> "Standardize systems. Make it mandatory, that all systems be compatible with 
each other. Make data more easily accessible to lay persons." 
Other comments that may be of interest include the following: 

> "Promote cost management to senior and mid-level leadership by including it 
leadership performance standards. - Increase leadership awareness of cost analysis 
as a distinct and valuable discipline within the of Comptroller Programs. (CP-11 
is not just BUDGETERS and MANAGEMENT ANALYSTS!!!) - Garner 
leadership support of training and professional development opportunities for cost 
analysts. The HQ of my organization was and is still slow on the uptake to fully 
comprehend the scope of the various cost management programs, their linkages 


and how to integrate them into decision making. Believe the source of the 
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problem is that when the organization was stood up, there was no recognition of 
cost analysts as a distinct discipline because of the drive to standardize job series 
and descriptions. Consequently there was no inventory of cost analyst capability 
on staff, with the result that contractors have been hired to perform things which 
staff cost analysts did. An ironic course of action considering the concern about 
cost containment." 

"The cost effort must be bottom-up. All MACOMs have loose assets that perform 
cost functions upon request and as needed. Army need to re-shape the RM 
structures at MACOM level to incorporate costing as a permanent function of 
MACOMs RMs. In a zero sum strategy, I would initiate an aggressive cost 
training program to incorporate cost responsibilities in several of the CP11 career 
program series’ (343, 560, etc.). This action might include creating or re-labeling 
divisions or sections within MACOMs RMs that can gather an array of Army 
civilians with different skills and series to perform the costing function. For 
example; a section that could gather 0560 Budgeters, 343-Management Analysts, 
Economists, ORSA, Manpower Specialists and other costing professionals. This 
costing team would be most effective at the MACOM level." 

"Have models validated by independent source. Then use the information the 
model generates as the optimal requirements for that program. Then prioritize 
resources based on all requirements. We spend much time on second guessing our 
models output." 

"Once costs are captured from Army activities, make the information available for 
general use in 'read and print' formats by other Army activities to encourage 
standardization and efficiency/effectiveness." 

"Often times, generic applications intended for the civilian sector don't translate 
well to the government/military environment. Also, cost applications and the 
resulting data tend to be subject to the interpretation of whoever is trying to prove 
a specific point. Finally, the Army has a habit of embarking on these ambitious 
programs supposedly to provide information for better decision making. The 


programs generally require considerable automation to work and unfortunately 
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the contractors are never quite able to deliver a system that fulfills the 
requirements originally envisioned. As a result, considerable resources are 
wasted. Let's make sure that we know what we want and that it will actually be 
used for decision making and not just develop a system to respond to some audit 
report or Congressional criticism." 

"People need to understand more than just pulling numbers out of a system and 
analyzing them. They need to understand what goes into making up those 
numbers. Automating systems to a point can lead to people punching numbers 
without an understanding of their impact on costs and programs. Reliability, 
accuracy and timeliness of cost information are negatively impacted by non- 
integrated disbursing and accounting operations. These two functions should be at 
the same finance and accounting activity whenever possible and not segregated 
for reasons of consolidating accounting information.” 

"The ability to rely on the data in any system is impacted by the emphasis placed 
on accuracy in data input. Unless the Army decides to increase the accountability 
of the individuals responsible for entering information into the system(s) then I 
will always remain skeptical of the information provided to me. GFEBS may be a 
great system but only high quality data will make it worthwhile." 

"Don't invest in a pie in the sky cost accounting system to try to capture every 
cost all at once. Instead, shift to a risk based approach to costing and attempt to 
capture accurate cost data for these functions that represent the most initial risk. 
Determine what it is you will do with cost data. Will we collect it for the sake of 
stating a bottom line cost of doing business or will we use it to evaluate the 
success of a program and actually attempt to save the taxpayer some money? By 
the way, as long as the Army remains budget centric there is little motivation to 
reduce annual budget requirements. Collect all the cost data you like but do 


something positive with the data." 
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V. OPPORTUNITIES FOR FURTHER RESEARCH 


Baseline assessments have now been conducted for both DoN and DA CE/A 
capabilities, and the DA CM capability. Opportunities are available to conduct similar 
analysis for Department of the Air Force, or to compare and contrast the capabilities 
already assessed. Follow on work could focus on the future needs of these communities. 
This work would then allow gap analysis to be conducted, ensuring DoD components are 
developing, providing and utilizing costing assets and capabilities as efficiently as 
possible. 

For the Benefit of the Army, the same survey used for the CM community would 
now be distributed to a different DA career field. DASA-CE Steve Bagby knows we 
have captured a large part of the cost management workers within DA, but would like to 
determine how many other CPs perform cost functions in the course of their work. 

The different methods of conducting surveys used for this thesis may provide 
additional research possibilities by comparing results of surveys completed by 
supervisors about their workforce as compared to the results of surveys completed by the 


workers themselves. 
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VI. PARTICIPANTS 


The participants in this study were developed from an initial list of personnel 
provided by DASA-CE Steve Bagby. With this original list and a DoD phone book, a 
more comprehensive POC list was developed. The key here was asking each potential 
POC, "Who else should we talk to?" Once completed, the POC roster did not necessarily 
include the chiefs of each division, but the XO, assistant, or other individual who would 
be completing the surveys most accurately within each division. The Participants were 
further broken down into two groups: (1) the CE/A community and (2) the CM 
community. Table 2 is a list of the points of contact and their organizations for the CE/A 


community within the U.S. Army. SMDC and AMC did not complete surveys. 






































Table 2. CE/A Organizations within the U.S. Army, and their points of contact. 
TACOM Rich Bazzy (586) 574-6665 richard.bazzy@us.army.mil 
AFSC Richard Jayne (309) 782-6538 richard.jayne@afsc.army.mil 
ALMC William Burnham (804) 765-4736 william.burnham@us.army.mil 

(256) 955- 

SMDC Ms. Lisa Gilbert 4575/5521 lisa.gilbert@us.army.mil 
CECOM Howard Douglas (732) 427-2711 howard.p.douglas@us.army.mil 
AMC Ken Freund (806) 617-9100 ken.freund@us.army.mil 
AMCOM Frank Lawrence (256) 842-2817 frank.t.lawrence@us.army.mil 
RDECOM Roger Staso (410) 436-5041 roger.staso@us.army.mil 











Cost&Perf Mgmt 








Div Mr. Steve Barth (703) 692-7399 stephen.barth@us.army.mil 

Contractor Spt Mr. Mike Streff (703) 692-7412 michael.streff@hqda.army.mil 
(703)797- 

Calibre Bill Matfeld 8819/8500 bill. mattfeld@calibresys.com 








Unit Mssn Cost Div 


Mr. Joel Gordon 


(703) 692-7388 


joe.gordon@us.army.mil 





Costing Review Board Office 


Mr. Morteza Anvari 


(703) 601-4150 


morteza.anvari@hqda.army.mil 








Acquisition Costing Directorate 


COL Arthur Kron 


(703) 601- 
4200/4199 


arthur.kron@us.army.mil 





Weapon System Division 


Mr. Sean Vessey 


(703) 601-4138 


sean.vessey@us.army.mil 








C4ISR Costing Division 


Mr. John Carroll 


703) 601-4168 


john.e.carrolli@us.army.mil 





Cost Policy & Research Division 


Mr.David Henningsen 


david.henningsen@us.army.mil 








G8 Executive Services Division 





Ms. Dianne Letsche 


(703) 
(703) 601-4163 
(703) 602-7552 


dianne.letsche@us.army.mil 








Table 3 is a list of the department heads/ division chiefs and their organizations 


for the CM community within the U.S. Army. 


It is no coincidence that the 11 


organizations within the U.S. Army are the 11 business areas within the U.S. Army. A 
complete listing of the CM participants is not included since there was a target population 
of over 9000 participants. 
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Table 3. CM Organizations within the U.S. Army, and the department heads/ division 






























































chiefs. 

Acquisition ASA(ALT) Dale Fletcher 703)614-3753 dale.fletcher@saalt.army.mil 
IMA ASA(ALT) JoAnn Blanks 703) 602-1796 jo.blanks@hgda.army.mil 
Civ Human Ms Elizabeth elizabeth.throckmorton@us.army.mil; 
Res Army G1 Throckmorton 703) 695-5701 debra.george@us.army.mil 
Contracting ASA(ALT) LTC Mark Conley (703)695-2488 mark.conley@hqda.army.mil 
Depots Army G4 COL Michael Ramsey 703) 614-4444 michael.ramsey@us.army.mil 
Info Support Army G6/CIO Mr. John Roe (703) 806-8628 john.roe@us.army.mil 
Inst Trng Army G3 COL Joe Back 703) 614-9853 joe.back@hqda.army.mil 
Ordnance Army G4 COL Michael Ramsey 703) 614-4444 michael.ramsey@us.army.mil 
R&D Labs ASA(ALT)-RT Gary Peck (703) 601-1549 ary.peck@saalt.army.mil 
Supply Mgt Army G4 COL Michael Ramsey 703) 614-4444 michael.ramsey@us.army.mil 

Mr. John Foulkes” Mr. 703) 695-8995 wagnerj@hqda.army.mil; 
Test & Eval TEMA Raymond Wagner 703) 614-4318 foulkib@hqda.army.mil 
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ANNEX A. CE/A SURVEY 
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REVIEW AND TRANSFORMATION OF 
DEPARTMENT OF THE ARMY COST ESTIMATING AND 
ANALYSIS (CE/A) CAPABILITIES 


The purpose of this effort is to assess the DA CE/A community, including a comprehensive, 
objective, and detailed assessment and analysis that compares the current status of people, 
processes, technologies and capabilities within CE/A and to those that are needed to meet the 
challenges of the Department of the Army in the 21st century. 


The overarching goal of this effort is to ensure that the DA CE/A community provide high 
quality, responsive, and customer-focused support at all levels within DA. 


Responding Organization: 
Date: 


Respondent's Name and Position: 


Interviewer(s): 
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PERSONNEL (Answer for personnel in your organizatio! 


1. Number of FTEs 














2. Number of personnel, by Grade levels 





GS 1- 
11 


GS 12-13 


GS 14-SES 




















3. Number of personnel, by total number of years of cost estimating/analysis 
related experience 





















































11- 
1-5 6-10 20 21 + 
4. Number of personnel, by hic 
academic degree 
High School | BAor BS | Graduate Degree 
5. Number of personnel with professional certifications 
Cost estimating | DAWIA Other 
professional 
certification: 
SCEA | PMP Level | Level II Level Ill 


























6. What is the source from which you have drawn your current personnel? 





What is the approximate percent of your 
current personnel whose last job was 





College 





Any _ other government, 


agency 





Commercial 
organization 








Other 











PROCESSES 


Functional responsibilities (What you do): Fill out the 
table below, indicating which CE/A functions your 
organization has responsibility for and then estimate the 
distribution of total workload that goes into each. 


LEVEL OF EFFORT FOR EACH WORKLOAD 








CATEGORY 
Very small Small Moderate Large 
< 10% 10-20% 20-50% > 50% 





Cost 
Estimating/Analysis 
(LCCE, ICE, AoA, EA, 
IBR) 


Contract Support (EVM, 
IGCE, Source Selection) 








Tool Building (Cost 
Research, Training, Data 
Collection, CER 
Development, Model 
Building 


Agmi inistration 
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Tasking origins (Who asks us to do CE/A?): Fill out the 
table below, indicating who provides the tasking to your 








organization. 
WHO PROVIDES TASKINGS TO YOUR ORGANIZATION? 
PM | PEO | SECDEF SECARMY | HQDA MACOMs | CAIG | Other | Other 
(which 
ASA?) 





Cost 
Estimating/Analysis 
(LCCE, ICE, AoA, EA, 
IBR) 





Contract Support 
(EVM, IGCE, Source 
Selection) 





Tool Building (Cost 
Research, Training, 
Data Collection, CER 
Development, Model 
Building 








Administration 






































DOES ANYONE BESIDES THE TASKING AGENCY GET A COPY OF YOUR 
PRODUCT? 





CBO 


SECDEF 


SECARMY 
(ASA*) 


HQDA 


MACOMs 


CAIG 





Cost 
Estimating/Analysis 


(LCCE, ICE, AoA, EA, 


IBR) 





Contract Support 
(EVM, IGCE, Source 
Selection) 





Tool Building (Cost 
Research, Training, 
Data Collection, CER 
Development, Model 
Building 





Administration 
































*Identify which ASA 


: FM&C, ALT, etcetera 
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RECRUITING - Is there, within your organization, a standardized or 
written procedure for performing the task? If there is a standardized or 
written procedure, is there a process chart? 


TRAINING - Is there, within your organization, a standardized or written 
procedure for performing the task? If there is a standardized or written 
procedure, is there a process chart? 


© What problems are there with training programs? What suggestions do you have to make 
the training program betier, either within your organization, or within the DA CE/A 
community? 
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Quality Assurance - Is there, within your organization, a standardized or 
written procedure for performing the task? If there is a standardized or 
written procedure, is there a process chart? 


© What problems are there with QA? What suggestions do you have to make 
QA better? 


Knowledge Management and Knowledge Sharing - Is there, within 
your organization, a standardized or written procedure for performing the 
task? If there is a standardized or written procedure, is there a process 
chart? 


© How do you leverage technology and employ knowledge management (KM) 
to improve the efficiency of your processes? 
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TECHNOLOGIES 


Methodologies-- Do you have access to or a license for the following 
commercial tools? For those tools for which you do have access or a 
license, to what extent do you use the tool? Please add to the list any 
commercial tools you use for cost estimating and analysis. 





DO YOU HAVE | IF YOU HAVE ACCESS OR A LICENSE, HOW 
ACCESS TO OR | HEAVILY DO YOU USE THE TOOL? 








COMMERCIAL TOOL A LICENSE | RARELY | OCCASSIONALLY | FREQUENTLY 
FOR, THIS 
TOOL? 





Software cost estimating 
models (SEER-SEM and 
PRICE-S) 

Hardware cost estimating 
models (SEER-H- and 








PRICE-H) 

ACEIT (Automated Cost 
Estimating Integrated 
Tools) 





Crystal Ball (cost risk 
analysis model) 

Gartner Group’s TCO 
Manager 

Decision-Making Support 
Applications (Team Expert 
Choice, Logical 

Decisions for Windows) 
Equipment Designer Cost 
Analysis System (EDCAS) 
USCM (Unmanned 
Spacecraft Cost Model, 
versions 5 & 7) 

NASA/Air Force Cost 
Model (NAFCOM 99) 

PRICE Estimating Suite 
(PES) 

REVIC 

Other 

Other 

Other 
























































DATA-- DO YOU BUY IT? COLLECT IT? GET IT BY 
SWAPPING/SHARING IT? 
66 


If you were in charge, what would you do or advise be 
done to make the cost estimating and analysis community 
function better? 


Who else should we talk to? 
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ANNEX B. CM SURVEY 
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REVIEW AND TRANSFORMATION OFDEPARTMENT OF 
THE ARMY COST MEASUREMENT, COST ANALYSIS, 
AND COST MANAGEMENT CAPABILITIES 


The purpose of this effort is to assess the current Army community 
engaged in cost measurement, cost analysis, and cost management to compare 
the current status of people, processes, technologies and capabilities to those 
that are needed to meet the challenges of the Army in the 21st century. 


The overarching goal of this effort is to ensure the Army costing 
community provides high quality, responsive, and customer-focused 
support at all levels within the Army. The following definitions are 
provided to assist respondents in identifying their roles and participation, if 
any, in Army costing efforts. 


1. Cost Collection — the collection for costing purposes of obligation 
and expenditure (financial) data, other cost data, workload and 
performance data, and inventory data. 


2. Cost Measurement — the use of the data gathered under cost 
collection to create managerial (not budget or financial) views of costs 
including indirect versus direct costs, overhead and/or general and 
administrative costs, incremental costs, full (or fully burdened) costs, 
process costs, project costs, ABC costs, Service Based Cost/Installation 
Status Report (SBC/ISR) costs, unit costs, and product/service costs. 


3. Cost Analysis — the analysis of the costs generated under cost 
measurement to enable managers and decision makers to make sound 
business decisions. This includes performing trend analysis, assessing 
productivity improvements, performing business case analysis (BCA) and 
economic analysis (EA), and benchmarking using cost information. 


4. Cost Management - the use of the cost analysis products to make 
sound business decisions including improving business processes, realigning 
resources, eliminating waste, influencing cost drivers, and planning operations. 


5. Costing Support Functions — training in costing efforts, supervising 
costing efforts, and providing headquarters staff and oversight support of costing 
efforts and programs. 
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TARGET POPULATION FOR THIS SURVEY: Any Department of the 
Army civilian 
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PERSONAL COSTING EXPERIENCE 


1. Select your grade. (Check only one) 


O SES O GS 10 or equivalent 

O GS 1-5 or equivalent O GS 11 or equivalent 

O GS 6 or equivalent O GS 12 or equivalent 

O GS 7 or equivalent O GS 13 or equivalent 

O GS 8 or equivalent O GS 14 or equivalent 

O GS 9 or equivalent O GS 15 or equivalent 

2. Select your career program or career field. (Check only one) 

O None O 
Engineer/Scientists (Construction) CP-18 

CO CHR Management CP-10 O Transportation 
Management CP-24 

O Comptroller CP-11 O Manpower/Force 
Management CP-26 

O Supply Management CP-13 O Installation Management 
CF-29 

O Contracting/Acquisition CP-14 O Training CP-32 

O Engineer/Scientists (Non-Construction) CP-16 OO IT Management 
CP-34 

O Materiel Maintenance Management CP-17 CO MWR CF-51 


O Other Specify: 


3. Enter your job series. (use 4 digits, e.g., enter “0343” for 343) 


GS-OOOO 


4. Select the type of position. (Check only one) 
O Full time permanent 
O Full time temporary 
O Part time 
O Intermittent (term) 


5. Select the MACOM or Operating Agency to which you are currently assigned. 


(Check only one) 
O HQDA O INSCOM 
O IMA O CIDC 
O Other Army Field O MDW 
Operating Agencies O NETCOM 
MO Army PEOs and PMs O ATEC 
O Combatant OO USAREUR 
Commands O FORSCOM 
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O AMC O USARPAC 


O TRADOC [1 USARSO 
O EUSA O SMDC 
CO USACE CO USASOC 
O MEDCOM O SDDC 


O Other Specify: 
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Select the Army business area of the organization to which you are currently 


assigned. (Check only one) 
O Depot Maintenance 


O) Institutional Training 


Operations (1 Base Operations and 
Ol Supply Management Support 

(Wholesale) O Research and 
O Ordnance Development 
O Information Support O Test and Evaluation 
O Civilian Human O Contracting 

Resources O Systems Acquisition 


O Other mission Specify: 


6. Select your highest academic degree. (Check only one) 
O Doctorate 
O Masters 
O Bachelor 
O Associates 
O High School or equivalent 


7. What formal costing/cost management training (see definitions on cover) have 
you attended since 1 January 2000? (Check all applicable) 

O None. Skip to question #9. 

O 1 or more sessions at a professional conference 

O1 3+ days of software training on costing software including SAS Oros 
or ABM software 

O 1 to 3-day training class on cost management and/or costing 
methodologies 

OO Less than 10 hours within another professional development course 

O 10-40 hours in formal professional courses 

O 10-40 hours in web-based courses 

O Over 40 hours in formal professional courses 

O Over 40 hours in web-based courses 

O College course(s) for credit 


8. In what types of costing-related subjects have you received the training 
indicated above? (Check all applicable) 

Activity Based Costing/Management (ABC/M) 

Business Case Analysis (BCA) 

Cost Finding including Analogy, Engineering, and Delphi approaches 

Development of Cost Estimating Relationships (Parametric approach) 

Earned Value Management (EVM) 

Economic Analysis (EA) 

Process or Project Costing 

Productivity Improvement / Business Process Reengineering 


OOOOOOOO 
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O Service Based Costing (SBC) 
1 Statistical Applications to Costing 
O Other Specify: 


What category of costing functions do you perform in your current 
position? (Check all applicable) (see definitions on cover) 

O None - Stop. Do not complete the rest of the survey. If you want 
to provide comments on Army costing, proceed to the Comment section at 
the end of the survey 

O Cost Collection 

O Cost Measurement 

O Cost Analysis 

CO Cost Management 

O Costing Support Functions 


9. For the costing functions you checked above, what percentage of your annual 
time is devoted to each function? 


Cost Collection.............. % 
Cost Measurement ........ CUM 
Cost Analysis ........... ——_____— % 
Cost Management......... % 


Costing Support Functions 


10. Do you perform your costing functions in support of defense systems acquisition 
management? (Check only one) 
O No. Skip to question #14. O Yes. Continue with next 
question, 


11. Did you recently complete a survey on Army Cost Estimating and Analysis? 
O Yes. Stop. Do not complete the rest of the survey. 
O No. Contact Steve Barth at Steve.Barth@hqda.army.mil to obtain a 
copy of the cost analysis survey. Do not complete the rest of this survey. 





12. How many years experience do you have in costing functions? (Check only one) 
O Less than a year 
O 1 to 2 years 
O 3 to5 years 
O 6to 10 years 
O More than 10 years 


13. How many years have you been in your current costing position? (Check only 
one) 
O Less than a year 
O 1 to 2 years 
O 3 to 5 years 
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O 6to 10 years 
O More than 10 years 
14. Prior to your current costing position, where did you work? (Check only one) 
O With your current organization 
O With another Army organization 
O With another federal/DoD organization 
O) In the private sector 
O Other 


26% 


15. Which of the following methodologies/tools have you used in performing your 

costing functions? (Check all applicable) 
O Activity Based Costing/Management (ABC/M) 

O Business Case Analysis (BCA) 

O Cost Finding including Analogy, Engineering, and Delphi approaches 

11 Development of Cost Estimating Relationships (Parametric approach) 

MO Earmed Value Management (EVM) 

CO Economic Analysis (EA) 

O Process or Project Costing 

O Productivity Improvement / Business Process Reengineering 

O Service Based Costing (SBC) 

O Trend Analysis 

O None of the above 

16. How do you share your costing information and experiences? (Check all 
applicable) 

Writing articles for publication 

Giving briefings and presentations at professional forums 

Presenting formal training 

Conducting on-the-job training 

Participating in an email list-serve 

Posting items in Army Knowledge On-Line (AKO) 

Posting information to a locally established system 

Informally by assisting others upon their request 

I don’t 

Other Specify: 


OOOOOOO0OO000O 


17. Are you currently in management or a supervisor’s position? (Check only one) 
O Yes 


18. Does your performance appraisal include an assessment on your use of costing 
information to improve the organization? (Check only one) 
O Yes 
O No 
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ORGANIZATIONAL COSTING IMPLEMENTATION 


19. In your current position, which of the following costing-related functions have 
you performed? (Check all applicable) 

O Assessed an organization’s capacity for change 

O Conducted training in costing techniques and managerial application of 
costing information 

O Participated in the creation of a strategic plan 

O Linked costing efforts with an organization’s strategic plan 

O Linked cost information with other performance measures 

CO Developed a costing methodology to support management decisions 

C1 Developed a software application to collect and/or generate costs and 
cost estimates 

O Collected information for costing purposes 

O Created cost (not budget) information 

O Performed analysis of cost information 

O Provided assistance to an organization’s leadership and management in 
using costing analysis 

CO Developed baseline costs for an improvement or benchmarking effort 

O Used cost analyses to make decisions for improving an organization or 
process 


20. Is the head of your organization rated on her/his use of costing information to 
improve the organization? (Check only one) 
O Yes 
O No 
O I don’t know. 


21. What importance does your organization’s external change of command place 
on internal management and control of costs? (Check only one) 


Very Somewhat Not very Not at all 
O O O O 


22. What impact does costing information and efforts have on your organization’s 
internal operations? (Check only one) 
Significant Some Minimal None 


O O O O 


23. How important is the internal management and control of your organization’s 
costs to the success of your organization? (Check only one) 
Very Somewhat Not very Not at all 
O O O O 
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24. How important is the internal management and control of your organization’s 
costs to your personal success within the organization? (Check only one) 
Very Somewhat Not very Not at all 
O O O O 
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25. How important is the internal management and control of costs to the success of 
your immediate supervisor? (Check only one) 
Very Somewhat Not very Not at all 
O O Oo QO 


26. What priority does it appear to you that the head of your organization gives to 
the internal management and control of your organization’s costs? (Check only 
one) 

High Mid-level Low None 
O O O QO 


27. How often do your organization’s leaders/managers formally review their 
costing information? (Check only one) 


O Daily O Quarterly 

O Weekly O Semi-annually 
O Every pay period O Annually 

O Monthly O Biannually 


O Other = Specify: 


28. Do you generate costing information (cost measurement and cost analysis) in 
your current position? (Check only one) 
O Yes. Continue with next question. 
O No. Stop. You are finished with this part of the survey. Go to the 
Comments section at the end of the survey to provide any comments. 





29. Which of the following methodologies/tools have you used in your current 
position? (Check all applicable) 

Activity Based Costing/Management (ABC/M) 

Business Case Analysis (BCA) 

Cost Finding including Analogy, Engineering, and Delphi approaches 

Development of Cost Estimating Relationships (Parametric approach)) 

Earned Value Management (EVM) 

Economic Analysis (EA) 

Process or Project Costing 

Productivity Improvement / Business Process Reengineering 

Service Based Costing (SBC) 

Trend Analysis 

None of the above 


OOOOOOO0O0000 
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30. What software do you use to create your costing information? (Check all 
applicable) 

MS Excel 

MS Access 

Other database application (SQL, Oracle, etc.) 

SAS Oros 5.5 

SAS ABM 6.x 

Other ABC software application 

ECONPAK 

ACET-IT 

Other Specify: 


OOOOOOOOO 


31. What is the source of the data for your measurement and/or analysis? (Check 
all applicable) 

A financial system such as SOMARDS or STANFINS 

A resource management system such as IMA on-line or AWPS. 

A standard functional system such as SARSS, IFS, SPS, or DCPS 

A cost factors’ system or database such as OSMIS or ISR 

Army websites 

Internet websites external to the Army 

A contractor 

An internally developed software application 

Other internal data collection 

Other Specify: 


OOOOOOO0OO000 


32. How often do you update your costing information? (Check only one) 


O Daily O Quarterly 

O Weekly O Semi-annually 
O Every pay period O Annually 

O Monthly O Biannually 


O Other Specify: 


33. How do you validate your costing data? (Check all applicable) 
CO Compare with data from other sources 
1 Statistically sample the data and verify its accuracy 
O Use data validated/audited by others 
O I don’t 
O Other Specify: 
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34. To whom do you provide costing information? (Check all applicable) 


OOOOOOOO 


Immediate supervisor 

Managers across your organization 

Your organization’s business or resource management office 
Head of your organization 

Higher headquarters 

An information system accessible by multiple organizations 
Organizations external to your organizational chain 

Other Specify: 


35. What means do you use to provide costing information? (Check all applicable) 


OOOOOOOOO 


Provide a hard copy report or briefing 

Use email to forward information 

Post information to a website 

Post information on a LAN 

Manually enter information in a system 

Import a file electronically into a system 

Provide a file to be electronically imported into a system 
Other system automatically pulls the data from your system 
Other Specify: 


36. How is this costing information used? (Check all applicable) 


O 


Evaluate and make business improvement decisions for your 


organization 


OOOOOOOO0O0000 


Manage and control costs for your organization 

Measure and evaluate performance for your organization 
Justify/generate resource requirements and budgets 
Fulfill higher headquarter reporting requirements 

Assess costs and/or performance of subordinate organizations 
Conduct benchmarking 

Establish prices and chargeback rates 

Measure project progress 

Evaluate contractor performance 

Compare alternatives for decision makers 

I don’t know 

Other Specify: 


a8). 


COMMENTS 


what improvements would you suggest to advance Army 
costing functions? 


Provide comments on this survey. 
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ANNEX E. PROS AND CONS OF WEB-BASED SURVEYS 


Using a web-based survey for the CM community turned out to be very beneficial 
due to the number of questions per survey and the large number of respondents. The 
web-based survey allowed for results to be viewed in three different ways: 1) on-line, 2) 
results emailed in a word document, complete with charts, graphs and summary statistics, 
or 3) as an excel spreadsheet, with respondents by row, answers by column. Included 
with the Excel spreadsheet was an additional Excel spreadsheet identifying how answers 


were coded (e.g.: yes = 1, no = 2, don't know = 3). 


For daily status checks, when it was important to know how many respondents 
had completed the survey and the MACOMSs to which they belonged, I viewed results on- 
line. When interested in determining the grade or series of respondents by MACOM, the 
on-line viewing application allowed the responses to one question to be broken out based 
on the response to a second question. This resultant table could then be forwarded to 
DASA-CE for assistance in encouraging participation where participation may have been 


lacking. 


The ability to create tables of responses for two separate questions was convenient 
in that it took only seconds to compare responses to any one question against the 
response to any other question. This convenience allows for multiple comparisons in an 
effort to determine if there may be correlation in any area. Because responses are 
available in excel, immeasurable time is saved by not having to code responses yourself. 
Also, for those prone to error, the possibility of coding incorrectly is eliminated. 
Dissemination of results to interested parties is also possible since virtually everyone has 


access to MS Excel. 


The survey itself is available to anyone with internet access (again, virtually 
everyone) and the correct URL. The URL was emailed to potential respondents, and 
once employed, a cookie installed on the computer does not allow access to the survey 
again for 14 days. This is meant to deter anyone from answering more than once, but it is 


not fool proof. Another drawback to the web-based survey was the lack of a 'back' or 


- 99 - 


‘previous question’ button. Several respondents stated that they would have preferred the 


ability to verify their answers before submitting the survey, but that was not possible. 


For personnel who responded to the survey either by email or face-to-face, either 
Dr. Nussbaum or I was available to clarify any uncertainty or confusion prior to the 
respondent submitting the survey. For the respondents who used the web-based survey, 
there was no way to leave the survey, seek clarification, and open the survey again the 
next day (due to the 14-day cookie). This, in part, may have led tho the steady decline in 


the number of respondents as the survey went on. 


For this type of project, where time is of the essence, and the risk of the cost 
management community wanting to sabotage the effort is low, I believe the benefits of 


using a web-based vehicle far outweigh the hazards. 
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